SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN THAT I, MITSUO ANDO , a citizen of 
Japan residing at Fukuoka, Japan have invented certain 
new and useful improvements in 

IMAGE FORMING APPARATUS AND METHOD FOR OPERATING IMAGE 
FORMING APPARATUS BY USING REMOTE APPLICATION 



of which the following is a specification:- 



1 . Field of the Invention 

The present invention relates to techniques 
for operating an image forming apparatus by using a 
Java application. 

2 . Description of the Related Art 
Recently, an image forming apparatus (to be 

referred to as a compound machine hereinafter) that 
includes functions of a printer, a copier, a facsimile, 
a scanner and the like in a cabinet is generally known. 
The compound machine includes a display part, a 
printing part and an image pickup part and the like in 
a cabinet. In the compound machine, pieces of software 
corresponding to the printer, copier and facsimile 
respectively are provided, so that the compound machine 
functions as the printer, the copier, the scanner and 
the facsimile respectively by switching the pieces of 
software . 

Since the conventional compound machine is 
provided with respective pieces of application software 
for the printer, the copier, the scanner and the 
facsimile, much time is required for developing each 
application. To solve this problem, the applicant has 
developed a compound machine including hardware 
resources, a plurality of applications, and a platform 



including various control services provided between the 
applications and the hardware resources. The hardware 
resources are used for image forming processes for a 
display part, a printing part and an image pickup part. 
The applications perform processes intrinsic for user 
services of printer, copier and facsimile and the like. 
The platform includes various control services for 
performing management of hardware resources necessary 
for at least two applications commonly, and for 
performing execution control of the applications and 
image forming processes, when a user service is 
executed . 

According to such a new compound machine, the 
applications and the control services are provided 
separately. Thus, after the compound machine is 
shipped, users or third party venders can develop new 
applications to install on the compound machine without 
changing the system side software. 

Various applications are developed. For 
developing the applications, from a viewpoint of 
supporting various platforms and network communications, 
it is considered to use Java applications as 
applications for the compound machine. As a 
conventional technology relating to the Java 
application, a technology described in Japanese laid 
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open patent application No . 2002-287990 is known, for 
example . 

For executing the Java applications on the 
compound machine, a module is necessary for managing 
5 the Java applications. In addition, for developing the 
Java application for the compound machine, it is 
necessary to evaluate the developed application whether 
the application actually operates on the compound 
machine after the Java application is developed on a PC 

10 and the like. However, it is troublesome to install 
and execute the Java application on the compound 
machine every time when the evaluation is performed. 
Thus, an environment is required in which the developed 
application can be directly executed on the compound 

15 machine from the PC on which the application is 

developed. In addition, if remotely executed Java 
application can operate the compound machine, user 
convenience increases for using the Java application. 

20 S Um^ARY QF THE INVENTION 

An object of the present invention is to 
provide an environment in which the Java application 
can be easily executed in the compound machine and to 
provide an environment in which the compound machine 

25 can be operated by a Java application that is executed 
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on a terminal apparatus such as the PC. 

The above object is achieved by an image 
forming apparatus that includes a control part that 
provides common services on control of hardware 
5 resources to a plurality of applications so as to be 
able to include a plurality of applications, the image 
forming apparatus including: 

a virtual machine; 

an application that is executed by the 
10 virtual machine; and 

an application management part managing the 
application that is executed by the virtual machine. 

According to the present invention, since the 
virtual machine is provided on the application layer of 
15 the image forming apparatus, the Java application that 
can be executed by the virtual machine can be executed. 
In addition, since the application management part is 
provided, it is easy to add, delete, and manage Java 
applications. Thus, the Java application can be easily 
20 executed on the image forming apparatus. 

In the image forming apparatus , the 
application that is executed by the virtual machine can 
operate the image forming apparatus by. using classes 
for controlling the image forming apparatus. The 
25 classes include an operation panel class for outputting 
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information to an operation panel of the image forming 
apparatus and for inputting information from the 
operation panel. By using the classes, the Java 
application can be easily developed. 
5 In the image forming apparatus , the 

application management part includes execution 
management functions that include a function for 
launching the application executed by the virtual 
machine. In addition, the application management part 

10 downloads the application when the application is not 
installed in the image forming apparatus . 

The application management part refers to an 
application information file associated with the 
application, and updates the application on the basis 

15 of information in the application information file. 
Since the application can be updated on the basis of 
the setting of the application information file, the 
application can be automatically updated. 

The application management part can compare a 

20 first version described in the application information 
file associated with the application with a second 
version described in another application information 
file associated with an update application, and the 
application management part replaces the application 

25 with the update application if the second version is 



newer than the first version. Thus, an old application 
can be automatically updated. 

The application management part may download 
the application from a memory card or from a Web site. 
In addition, the application management part may 
download the application from a location described in 
the application information file associated with the 
application. The application management part can check 
whether the application is executable in the image 
forming apparatus before downloading the application, 
and the application management part can check whether 
the application is executable on the basis of 
information described in the application information 
file associated with the application. In addition, the 
application management part can check items including a 
resource item in the image forming apparatus necessary 
for executing the application. Therefore, the 
application can be safely installed and updated. 

The image forming apparatus may include a 
server application that receives an operation request 
from a terminal apparatus connected to the image 
forming apparatus and that operates the image forming 
apparatus according to the operation request. According 
to the present invention, the image forming apparatus 
can be operated by the application executed in the 



terminal apparatus. The application management part 
communicates with the terminal apparatus . 

In addition, the above-mentioned object is 
achieved by a terminal apparatus that operates an image 
forming apparatus configured to be able to include a 
plurality of applications, the terminal apparatus 
including: 

a virtual machine; 

an application that is executed by the 
virtual machine and that operates the image forming 
apparatus ; and 

an application management part managing the 
application that is executed by the virtual machine. 

According to the present invention, the image 
forming apparatus can be operated by the application 
executed in the terminal apparatus . 

The terminal apparatus is connected to the 
image forming apparatus via a network, and the 
application that is executed by the virtual machine 
operates the image forming apparatus by using classes 
for controlling the image forming apparatus. In 
addition, the terminal apparatus can operate the image 
forming apparatus by using a Java based distributed 
object processing technique.- By using the Java based 
distributed object processing technique that supports 
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processing via a network, the image forming apparatus 
can be operated by an application executed in an 
apparatus on a network. 

In the terminal apparatus, the classes may 
5 include a function for displaying, on the terminal 

apparatus, an emulated screen of a screen displayed on 
an operation panel of the image forming apparatus . 
Thus, the user can operate the image forming apparatus 
from the terminal apparatus as if to operate the image 

10 forming apparatus directly. 

The terminal apparatus may have a function 
for allowing a user to select whether to access a hard 
disk of the image forming apparatus or to access a hard 
disk of the terminal apparatus. For example, the user 

15 can select a file stored in the hard disk of the image 
forming apparatus from the terminal apparatus . 

In the terminal apparatus, the application 
management part may include execution management 
functions that include a function for launching the 

20 application, and may download the application when the 
application is not installed in the terminal apparatus 
by communicating with the image forming apparatus. In 
addition, the application management part can refer to 
an application information file associated with the 

25 application, and update the application on the basis of 
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information in the application information file. 

The application management part can download 
the application from a memory card that is inserted in 
the image forming apparatus or from a Web site. In 
5 addition, the application management part can receive 
file information stored in the memory card and displays 
the file information on the terminal apparatus. 

The application management part can send URL 
information input into the terminal apparatus to the 

10 image forming apparatus, so that the image forming 

apparatus downloads the application from the Web site 
by using the URL information. Since the application 
management part communicates with the image forming 
apparatus for performing processes, the management 

15 function for applications in the image forming 

apparatus can be extended to the terminal apparatus . 

BRIEF DESCRIPTION QF THF PRA W I NGS 

Other objects, features and advantages of the 
20 present invention will become more apparent from the 

following detailed description when read in conjunction 
with the accompanying drawings, in which: 

Fig.l is a block diagram of a compound 
machine 100 according to an embodiment of the present 
25 invention; 
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Fig.2 shows an example of a hardware 
configuration of the compound machine 100; 

Fig. 3 shows a configuration example of a Java 
execution environment 116 according to a first 
5 embodiment ; 

Figs . 4A and 4B show implementation examples 
of an application management part 204; 

Fig. 5 shows an example of a hierarchy 
structure of the operation panel used by the Java 
10 application; 

Fig. 6 shows a program list of the Java 
application; 

Fig. 7 is a screen displayed by the simple 

printer; 

15 Fig. 8 is an example of a soft keyboard 

displayed by executing the simple printer; 

Fig. 9 is a flowchart showing a procedure for 
launching the simple printer according to the first 
embodiment ; 

20 Fig. 10 shows an example of a syntax of a JNLP 

file; 

Fig. 11 shows a tree structure of the JNLP 

file; 

Fig. 12 is a flowchart for automatically 
25 updating a Java application (update target application) 



in an SD card (which is an example of a memory card) or 
in a HDD with a Java application (update application) 
from a SD card; 

Fig. 13 is a flowchart for automatically 
updating a Java application (update target application) 
in the SD card or in the HDD with a Java application 
(update application) from a Web server; 

Fig. 14 shows a system configuration according 
to a third embodiment of the present invention; 

Fig. 15 is a flowchart showing a procedure for 
launching the simple printer according to the third 
embodiment ; 

Fig. 16 is a block diagram of the compound 
machine according to a fourth embodiment of the present 
invention; 

Fig. 17 shows classes of the JSDK application 
147 and the JSDK platform 148 in Fig. 16; 

Fig. 18 shows a system configuration according 
to the fourth embodiment; 

Fig. 19 shows classes of the JSDK application 
147 and the JSDK platform 148 in the PC 701 in Fig. 18; 

Fig. 20 is a figure for explaining execution 
procedure of preparation processes for remote operation 
in the compound machine 100. 
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PETAILEP DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following, embodiments of the present 
invention are described with reference to figures. In 
the following, a Java execution environment in the 
5 compound machine is described as first and second 
embodiments. Next, an environment in which the 
compound machine is operated by executing an 
application, developed in a PC and the like, in the PC 
is described as third and fourth embodiments. First, 
10 the compound machine used in the first to third 
embodiments is described. 

Fig.l is a block diagram of a compound 
machine 100 according to an embodiment of the present 
invention . 

15 As shown in Fig.l, the compound machine 100 

includes hardware resources 103 and a software group 
110. The hardware resources 103 include a black and 
white laser printer (B&W LP) 101, a color laser printer 
102, and hardware resources such as a scanner, a 

20 facsimile, a hard disk, memory (RAM, NV-RAM, ROM and 

the like) and a network interface. The software group 
110 includes a platform 120, and applications 130. 

The platform 120 includes control services 
for interpreting a process request from an application 

25 to issue an acquiring request for the hardware 
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resources , a system resource manager (SRM) 123 for 
managing one or more hardware resources and arbitrating 
the acquiring requests from the control services, and a 
general-purpose OS 121. 
5 The control services include a plurality of 

service modules, which are a system control service 
(SCS) 122, an engine control service (ECS) 124, a 
memory control service (MCS) 125, an operation panel 
control service (OCS) 126, a fax control service (FCS) 

10 127, and a network control service (NCS) 128. The 

platform 120 has application program interfaces (API) 
that can receive process requests from the applications 
130 by using predetermined functions. 

The general purpose OS 121 is a general 

15 purpose operating system such as UNIX, and can execute 
each piece of software of the platform 120 and the 
applications 130 concurrently as respective processes. 

The process of the SRM 123 is for performing 
control of the system and performing management of 

20 resources with the SCS 122. The process of the SRM 123 
performs arbitration and execution control for requests 
from the upper layer that uses hardware resources 
including engines such as the scanner part and the 
printer part, a memory, a HDD file, and a host I/Os 

25 (Centronics I/F, network I/F IEEE1394 I/F, RS232C I/F 



and the like) . 

The process of the SCS 122 performs 
application management, control of the operation panel, 
display of system screen, LED display, resource 
management, and interrupt application control. The 
process of the ECS 124 controls engines of hardware 
resources including the white and black laser printer 
(B&W LP) 101, the color laser printer (Color LP) 102, 
the scanner, and the facsimile and the like. 

The process of the MCS 125 obtains and 
releases an area of the image memory, uses the hard 
disk apparatus (HDD) , and compresses and expands image 
data. The process of the FCS 127 provides APIs for 
sending and receiving facsimile by using PSTN/ISDN 
network from each application layer, 

registering/referring of various kinds of facsimile 
data managed by BKM (backup SRAM) , facsimile reading, 
facsimile receiving and printing, and mixed sending and 
receiving . 

The NCS 128 is a process for providing 
services commonly used for applications that need 
network I/O. The NCS 128 distributes data received 
from the network to a corresponding application, and 
acts as mediation between the application and the 
network when sending data to the network. More 



-16- 



specif ically ^ the process of the NCS 128 includes 
server daemon such as ftpd, httpd^ Ipd, snmpd, telnetd, 
smtpd, and client function of the protocols. 

The process of the OCS 126 controls an 
5 operation panel that is a means for transferring 

information between the operator (user) and control 
parts of the machine. In the compound machine 100 of 
the embodiment, the OCS 12 6 includes an OCS process 
part and an OCS function library part. The OCS process 

10 part obtains an key event, which indicates that the key 
is pushed, from the operation panel, and sends a key 
event function corresponding to the key event to the 
SCS 122. The OCS function library registers drawing 
functions and other functions for controlling the 

15 operation panel, in which the drawing functions are 
used for outputting various images on the operation 
panel on the basis of a request from an application 
that has control right or from a control service. When 
the application is developed, functions in the OCS 

2 0 function library is linked to an object program that is 
generated by compiling a source code file of the 
application, so that an executable file of the 
application is generated. 

The applications 130 include a printer 

25 application 111 that is an application for a printer 
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having page description language (PDL) and PCL and post 
script (PS), a copy application 112, a fax application 
113 that is an application for facsimile, a scanner 
application 114 that is an application for a scanner, 
5 and a network file application 115. In addition, a 

Java execution environment 116 and a Java application • 
117 are included. The compound machine 100 shown in 
Fig.l includes a plurality of Java applications. 

Interprocess communication is performed 

10 between a process of the application and a process of 
the control service, in which a function is called, a 
returned value is sent, and a message is sent and 
received. By using the interprocess communication-, 
user services for image forming processes such as 

15 copying, printing, scanning, and sending facsimile are 
realized . 

As mentioned above, the compound machine 100 
of this embodiment includes a plurality of applications 
130 and a plurality of control services, and each of 

20 those operates as processes. In each process, one or 

more threads are generated and the threads are executed 
in parallel. The control services provide common 
services to the applications 130. User services on 
image formation such as copying, printing, scanning and 

25 sending facsimile are provided while the processes are 
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executed in parallel, the threads are executed in 
parallel, and interprocess communication is performed. 
A third party vendor can develop new applications for 
the compound machine 100, and can execute the 
5 applications in the application layer on the control 
service layer in the compound machine 100. 

Fig. 2 shows an example of a hardware 
configuration of the compound machine 100. 

As shown in Fig. 2, the compound machine 100 
10 includes a controller 40, an operation panel 60, a fax 
control unit (FCU) 65, and an engine 70 and a plotter 
75. 

The controller 40 includes a CPU 41, a MEM-P 
(system memory) 42, a north bridge (NB) 43, a south 
15 bridge (SB) 44, an ASIC 45, a MEM-C (local memory) 46, 
an HDD 47, a network interface card (NIC) 48, a USB 
device 49, an IEEE1394 device 50, and a Centronics 51. 

The operation panel 60 is connected to the 
ASIC 45 of the controller 40 directly. The FCU 65, 
20 interfaces, the engine 70 and the plotter 75 are 

connected to the ASIC 45 in the controller 40 via a PCI 
bus . 

The CPU 41 controls the compound machine 100. 
The NB 43 is a bridge for connecting the CPU 41, the 
25 MEM-P 42 and the ASIC 45. The MEM-P 42 is a system 
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memory used as a drawing memory for example. The SB 44 
is a bridge for connecting the NB 43 and peripheral 
devices. In this embodiment, a memory card slot 441 is 
provided in which a memory card 4 42 can be inserted. 
5 The MEM-C 46 is a local memory used as a copy image 

buffer, a code buffer and the like. The ASIC 45 is an 
IC for image processing including hardware for image 
processing. The HDD 47 is a storage for storing image 
data, programs, font data and the like. 

10 (First embodiment) 

Next, the execution environment 116 of the 
Java application 117 in the compound machine 100 is 
described as the first embodiment. 

Fig. 3 shows a configuration example of the 

15 Java execution environment 116 according to the first 
embodiment. As shown in Fig. 3, the Java execution 
environment 116 includes a compound machine class 
library 201, a virtual machine 202, a native program 
interface 203 and an application management part 204. 

20 The compound machine class library 201 is a 

class library used for the Java application 117 to 
easily operate the compound machine 100, so that the 
Java application 117 can access APIs of the compound 
machine 100 by using the mechanism of the native 

25 program interface 203. By the compound machine class 



library 201, machine-dependent functions can be 
identified, simple operation functions are provided, 
and various object oriented classes can be provided. 

The compound machine class library 201 
according to this embodiment includes a basic Java 
class library, event classes for processing events, 
network transaction classes for performing processes 
for network communications, operation panel classes for 
drawing images on the operation panel of the compound 
machine 100, compound machine control classes for 
controlling the compound machine 100 and the like. The 
operation panel class and the compound machine control 
class are classes specific for the compound machine 100 
of this embodiment. The operation panel class and the 
compound machine control class may be referred to as 
^^compound machine class" hereinafter, and other classes 
(the basic Java class library, event classes, network 
transaction classes) may be referred to as ^'Java core 
class''. 

A Java source code program is compiled into 
intermediate code (byte code) . The virtual machine 202 
has functions for interpreting and executing the byte 
code. The native program interface 203 has functions 
for the Java code executed by the virtual machine 202 
to be interoperable with applications and libraries 
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written by a different programming language such as the 
C language. 

The application management part 204 has 
functions for managing the Java applications. For 
5 example, the application management part 204 has 

functions for displaying a list of Java applications, 
installing and updating the Java applications, deleting 
installed Java applications, setting a password for 
registering applications, storing Java applications and 

10 the like. In addition, the application management part 
204 performs Java application execution management such 
as launch, forced termination, suspend, and resume for 
the Java application. 

The application management part 204 is 

15 implemented in the compound machine 100 as a component 
independent from the virtual machine 202, so that the 
application management part 204 cannot be controlled 
from the Java application 117. As shown in Figs . 4A and 
4B, the application management part 204 can be 

20 implemented as a Java application (Fig.4A), or can be 
implemented as a C language program (Fig.4B) or the 
like . 

Since the Java execution environment 116 is 
an application mounted on the compound machine 100, the 
25 Java execution environment 116 can be installed into 



-22- 



the compound machine 100 in the same way as other 
applications. For example, the Java execution 
environment 116 can be installed into the compound 
machine 100 from a memory card. 
5 (Example of Java application) 

Next, an example of the Java application is 
described. In the following example, a Java 
application that uses the operation panel class is 
described. Fig. 5 shows an example of a hierarchy 

10 structure of the operation panel class used by the Java 
application. Fig. 6 shows a program list of the Java 
application. In the following, the application program 
may be referred to as ^^simple printer". 

Next, the program shown in Fig. 6 is described. 

15 This program causes the compound machine 100 to display 
a user interface screen on the operation panel of the 
compound machine 100, receive a specified print file 
name from the operation panel, and print the specified 
file. The outline of the operation of the program is 

20 as follows. 

Right after the compound machine 100 is 
launched, a screen shown in Fig. 7 is displayed on the 
operation panel. As shown in Fig. 7, a character string 
^^Simple Printer'' is displayed on the upper part of the 

25 screen, and a button of ''Get input filename..." is 
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displayed on the center part of the screen. When the 
user touches the button of ^^Get input filename...", a 
software keyboard shown in Fig. 8 as an example is shown 
on the operation panel. On the software keyboard, a 
5 title : ^^Input file name" is displayed, so that the 
user inputs a name of a file that the user wants to 
print. For example, when the user inputs 
^Vusr/hdd/photo - tif f " , the program causes the compound 
machine 100 to print the ''photo . tiff " file that is 

10 stored in a directory : ^Vusr/hdd". 

In the following, the program is described 
according to the numbers of annotations of the program. 

^'(1)" is a command for using the compound 
machine class library. ^M2)" indicates that GWApp is 

15 inherited, in which GWApp is a prototype (abstraction) 
of the application of the compound machine on initial 
setting and end processing. Accordingly, the user does 
not need to write complicated initial setting code and 
end processing code, and processes for receiving a 

20 message and the like can be hidden from the user. 

By ^M3)", an object for operating a printer 
is created, and an object for displaying a message : 
'"Simple Printer" is created by "(4)", and a button 
object for ^^Get input filename..." is created by ^'(5)". 

25 ^'(6)" indicates to add an object such that a software 
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keyboard is displayed at the time when the user touches 
the button. ''"(7)" indicate to display the software 
keyboard and prompt the fine name. The file specified 
by the software keyboard is printed by ^M8)". 
5 In the button operation ((5) ^^Get input 

filename. the result of the button operation is 

received by the program as a message, and the program 
performs a process corresponding to the button 
operation in response to receiving the message. The 
10 process is set in addChangeListener { ) of (6). 

(Example of procedure from download to 

launch) 

Installing and launching of the Java 
application is managed by the application management 

15 part 204. Thus, by using the functions of the 
application management part 204, processes from 
download to launch can be performed in the following 
way. The procedure is described taking a case for 
launching the simple printer as an example with 

20 reference to a flowchart shown in Fig. 9. 

The application management part 204 is 
launched when the compound machine 100 is launched like 
other applications. By pushing an application 
selection key corresponding to the application 

25 management part 204, a user interface screen for 
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operating the application management part 204 is 
displayed on the operation panel of the compound 
machine 100 in step SI. When the user identifies, on 
the user interface screen, that the simple printer is 
5 installed as a Java application, the user selects the 
simple printer to execute it in step S2 . 

If the simple printer is not installed, an 
application load screen is displayed by specifying load 
of application from the user interface screen in step 
10 S3. 

On the application load screen, the user 
selects whether to download the simple printer from a 
Web site or to download it from a memory card inserted 
into the compound machine in step S4. 

15 In the case when the simple printer is 

downloaded from the memory card, the application 
management part 204 checks files in the memory card, 
and displays file names stored in the memory card on 
the operation panel in step S5. When the user selects 

20 the simple printer in step 86, the application 

management part 204 checks if the application can be 
executed on the compound machine 100 in step S7 . 
According to the result of the check, if the 
application can be executed, the application is 

25- downloaded and installed into the hard disk. In 
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addition, the application management part 204 obtains 
the application name (simple printer) and add it to an 
application list in step S9, in which the application 
list is a file managed by the application management 
5 part 204 for the user to recognize installed Java 
applications . 

In the case when the simple printer is 
downloaded from the Web server, Web is selected in the 
step S4, so that a screen for specifying a URL is 

10 displayed from which screen the user inputs a URL of a 
Web site having the simple printer program in step SIO. 
Then, the application management part 204 accesses the 
Web site in step Sll, and checks if the simple printer 
can be executed on the compound machine in step S12, 

15 and downloads the simple printer in step S13. Then, 

the application management part 204 installs the simple 
printer into the hard disk, obtains the application 
name (simple printer) and adds the name to the 
application list in step S14. 

20 Alternatively, the application management 

part 204 may automatically searches for the memory card 
or the Web server to install the application into the 
hard disk. In the above-mentioned example, although an 
example in which the Java application is installed into 

25 the hard disk is described, the Java application is not 
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necessarily installed into the hard disk to execute the 
Java application. 

For checking if the Java application can be 
executed in the compound machine 100, the application 
5 management part 204 checks program size, version of the 
program, program latest update information, use memory 
work size, use storage size, use network address, the 
term of validity (usable number) , application program 
name and the like. These items of information are 

10 associated with the Java application. As described 

later, the items of information may be obtained from a 
JNLP file corresponding to the Java application. 

After the above-mentioned processes ends, the 
downloaded simple printer can be used, so that the user 

15 launches the simple printer from the user interface 

screen in step S15. Accordingly, the virtual machine 
202 is launched and the simple printer is executed. 

The launched simple printer operates the 
compound machine 100 by using the Java core class and 

20 the compound machine class so as to display the before- 
mentioned user interface screen for the simple printer. 
The user inputs a name of a file that the user wants to 
print, so that the file is printed. In this example, 
'Vusr/hdd/photo. tif f " is input, and a "photo. tiff" file 

25 that is stored in a ''Vusr/hdd" directory in the hard 
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disk in the compound machine 100 is printed. 

After the printing ends, the application 
management part 204 terminates execution of the simple 
printer . 
5 (Second embodiment) 

The compound machine 100 can automatically 
update a Java application that is installed in the 
compound machine 100 by using JNLP (Java Networking 
Language Protocol) . In the following, automatic update 
10 of the Java application by using JNLP is described. 

Following processes are controlled by the application 
management part 204. 

Since ^VNLP file" (to be also referred to as 
^^application information file") is used in the 
15 following processes, a description is given first for 
the JNLP file. The JNLP file is in a one-to-one 
correspondence with a Java application, and includes 
information on definitions of the Java application. 
That is, a JNLP file is attached to each Java 
20 application. 

Fig. 10 shows an example of a syntax of the 
JNLP file. The JNLP file is a XML (extensible Markup 
Language) file. The format of the JNLP file is in 
conformity with JNLP standard. However, the JNLP used 
25 in this embodiment is extended. Following is the 
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extension . 

In Fig. 10, the description 1 is an 
information element which includes a title element 
(description lA) indicating an application name, a 
5 vender element (description IB) indicating a vender 

name, a telephone element (description IC) indicating a 
telephone number of the vender, a fax element 
(description ID) indicating a fax number of the vender, 
and a product ID element (description IE) indicating a 

10 product ID of the application. 

The description 2 indicates a security 
element. The description 3 indicates a resource 
element which includes a jsdk element (description 3A) 
indicating a version of a Java application, a jar 

15 element (description 3B) indicating a Jar file 

(execution file of the Java application) and the 
version, and a sub- j nip element (description 3C) 
indicating a SUB-JNLP file. 

The description 4 is an update element which 

20 is an element for setting an execution method of update. 
If the element is ^^auto", update of the application is 
automatically performed. If the element is ^^manual", 
update of the application is performed manually. If 
the element is ^^mail", an update notification mail is 

25 delivered when update of the application can be 
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performed . 

The description 5 indicates an install 
element which indicates an execution method for install 
If the element is ^'auto^', an install destination of the 
5 application is automatically selected. If the element 
is ^'manual'', the install destination of the application 
is manually selected. The description 6 indicates 
whether the type of the application is ^^GUI present'' or 
"'GUI absent". 

10 Information of the JNLP file corresponding to 

the Java application generally has a tree structure as 
shown in Fig. 11. A JNLP file referred to from an upper 
JNLP file corresponds to a module that is used in 
execution of a Java program corresponding to the upper 

15 JNLP file. 

As described in the update element of Fig. 10, 
an installed Java application is a target of update. 
In the following, automatic update for automatically 
updating the installed Java application is described. 

20 Fig. 12 is a flowchart for automatically 

updating a Java application (update target application) 
in an SD card (which is an example of a memory card) or 
in a HDD to a Java application (update application) 
from a SD card. 

2 5 When a SD card including the update 
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application is set in a SD card slot, the application 
management part 2 04 obtains a JNLP file of the update 
application in the SD card in step SlOl, When the 
update element of the JNLP file is ^'auto" and when the 
5 compound machine 100 includes an update target 
application same as the update application 
corresponding to the JNLP file (steps S102, S103) , the 
application management part 204 compares versions of 
the update application and the update target 

10 application in step S104. When the version of the 
update application is newer than the version of the 
update target application (step S105) , the application 
management part 2 04 updates the update target 
application to the update application in step S106 

15 (replaces the update target application with the update 
application). That is, the application management part 
204 updates the Jar file and the JNLP file. 

Fig. 13 is a flowchart for automatically 
updating a Java application (update target application) 

20 in the SD card or in the HDD with a Java application 
(update application) from a Web server. 

The application management part 204 obtains a 
JNLP file of the update target application in step S201. 
When the update element of the JNLP file is ^^auto'' and 

25 when the Web server that is connected to the compound 
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machine 100 includes an update application same as the 
update target application (step S202, S203) , the 
application management part 204 compares versions of 
the update target application and the update 
5 application in step S204. When the version of the 
update application is newer than the version of the 
update target application, the application management 
part 204 updates the update target application with the 
update application in- step S206. 

10 The destination that the compound machine 100 

accesses for accessing the update application can be 
obtained by referring to the JNLP file. When the JNLP 
file is the tree structure, the above-mentioned process 
is performed for JNLP files of each layer. 

15 The trigger for starting the update may be an 

elapsed time from power on of the compound machine 100, 
a predetermined time, power ON/OFF of the compound 
machine 100, before running/while running/after running 
application, an elapsed time while idling, and the like. 

20 Also in the first embodiment, the JNLP file 

can be used. In such a case, before downloading the 
Java application, the compound machine 100 can check if 
the Java application is executable according to 
information in the JNLP file. In this case, the JNLP 

25 file includes information used for determining whether 
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the Java application is executable in the compound 
machine 100. For example, the JNLP file includes 
information for authentication, device configurations 
(color supported, for example) necessary for executing 
5 the Java application, use resource information and the 
like in addition to the program size and the like 
described in the first embodiment. The information in 
the JNLP file are compared with resource information 
and the like in the compound machine ICQ. As a result, 

10 if the compound machine 100 determines that the Java 

application is not executable, a warning is output, for 
example. In addition, the Jar file may include a 
digital signature for authentication, so that the 
application management part 204 may verify the 

15 signature. 

(Third embodiment) 

Next, a method is described in which the 
compound machine 100 is operated remotely by executing 
a Java application in a PC which may be used for 

20 developing the Java application. 

Fig. 14 shows a system configuration for 
executing the Java application according to this 
embodiment. As shown in the figure, the system- 
includes a PC 300 and a compound machine 100 that are 

25 connected via a network 400. The PC 300 is a PC used 
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for developing a Java application for the compound 
machine 100, for example. 

The PC 300 includes a simple printer 301 that 
is a Java application, a Java core class 304, a client 
5 compound machine class 303 for operating the compound 
machine class in the compound machine 100, a remote 
application management part 302 for managing 
applications by communicating with the application 
management part 204 of the compound machine 100, a 

10 virtual machine 305 and a OS 306. 

The compound machine 100 includes a server 
compound machine application 210 in addition to the 
Java execution environment 116. The server compound 
machine application 210 is an application executed in 

15 the compound machine 100 for providing remote operation 
service from the PC 300. The native program interface 
is not shown in Fig. 14. 

The client compound machine class 303 in the 
PC 300 communicates with the server compound machine 

20 application 210, so that the client compound machine 

class 303 operates objects in the compound machine 100. 
Accordingly, the compound machine 100 can be operated 
remotely from the PC 300, and distributed processing of 
applications can be realized. The technique for 

25 operating objects in the compound machine 100 from the 
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remote PC 300 can be realized by using Java based 
distributed object processing technology, for example. 

The remote application management part 302 
communicates with the application management part 204 
5 of the compound machine 100 so that the Java 

application management function for the compound 
machine 100 can be extended to the PC 300. The remote 
application management part 302 includes functions same 
as those of the application management part 204 of the 

10 compound machine 100. That is, the remote application 
management part 302 includes functions for the Java 
application execution management (launch / forced 
termination / suspend / resume and the like) , install 
and update of the Java application, delete of installed 

15 Java application, password setting for application 

registration, storing Java application, display list of 
installed Java applications and the like. The above- 
mentioned processes are performed by communicating with 
the application management part 204 of the compound 

20 machine 100 as necessary. 

The client compound machine class 303 in the 
PC 300 also includes a function for emulating a part of 
functions of the compound machine 100. For example, 
the client compound machine class 303 can emulate 

25 operations of the operation panel of the compound 



-36- 



machine 100. 

For operating the compound machine 100 by 
using an application executed in the PC 300, it can be 
selected whether to use the operation panel of the 
5 compound machine 100 or to use the emulation function 
in the PC 300. In the case where the operation of the 
operation panel is emulated, the screen to be displayed 
on the operation panel of the compound machine 100 is 
displayed on the PC 300. The keyboard and the mouse of 

10 the PC 300 are used for operating the operation buttons 
displayed on the PC 300. The selection between using 
the operation panel of the compound machine 100 and 
using the keyboard and the mouse of the PC 300 is 
performed by sending a request from the remote 

15 application management part 302 to the application 

management part 204 of the compound machine 100. For 
example, when the remote application management part 
302 notifies the application management part 204 in the 
compound machine 100 that the PC 300 emulates the 

20 operation panel, the application management part 204 
controls the compound machine 100 such that screen 
display information generated by operating the compound 
machine 100 is sent to the PC 300 instead of displaying 
on the compound machine 100. 

25 When executing the Java application from the 
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PC 300, as to same kind of resources in the remote PC 
300 and the compound machine 100, the user can select 
one between the remote PC 300 and the compound machine 
100. For example, as to ^^hard disk" that is included 
5 in both of the PC 300 and the compound machine 100, the 
user can select whether using a hard disk of the PC 300 
or a hard disk of the compound machine 100 from the PC 
300. Other such resources are resources for networking, 
I/0(USB, ilink, RS 232C) and the like. 

10 Next, in the environment indicating Fig. 14, a 

procedure for operating the compound machine 100 by 
executing a Java application in the PC 300 is described 
with reference to a flowchart of Fig. 15. In the 
following example, the simple printer is used as an 

15 example. 

First, the remote application management part 
302 is launched in the PC 300. In the compound machine 
100, the Java execution environment 116 including the 
application management part 204, and the server 

20 compound machine application 210 are already executed. 

The remote application management part 302 
displays a screen for selecting an application on the 
PC 300 in step S21. At this time, it is checked 
whether the Java application is installed in the hard 

25 disk in the compound machine 100 or in the hard disk in 
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the PC 300. In the check of the Java application, for 
example, the remote application management part 302 
checks the Java application in the PC 300, and the 
application management part 204 in the compound machine 
5 100 checks the Java application in the compound machine 
100 and the application management part 204 notifies 
the remote application management part 3 02 of the check 
result. When the Java application exists, the Java 
application name is displayed on the screen. When the 

10 user selects the simple printer, the simple printer is 
launched in step S22. 

As a result of the check whether the Java 
application is installed, if the Java application is 
not installed in either of the hard disks, an 

15 application load screen is displayed by specifying 
application load from the screen in step S23. 

The user selects, from the application load 
screen, whether to download the simple printer from a 
Web site or from a memory card inserted in the compound 

20 machine 100 in step S24. 

When the user select to install the Java 
application from the memory card, the application 
management part 204 recognizes the memory card when the 
memory card is inserted into the compound machine 100, 

25 and the application management part 204 checks file 
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information in the memory card, and notifies the remote 
application management part 302 of the file information 
in step S25. 

The remote application management part 302 
5 displays the notified file information on the screen of 
the PC 300 in step S26 , so that the user selects the 
simple printer in step S27. Then, the remote 
application management part 302 notifies the 
application management pat 204 that the simple printer 

10 is a target for downloading. The application 
management part 2 04 sends information on the 
application (simple printer) to the remote application 
management part 302. The remote application management 
part 302 checks whether the simple printer is 

15 executable in the environment of the system in step S28. 
If the remote application management part 302 
determines that the simple printer is executable, the 
remote application management part 302 instructs the 
application management part 204 to download the simple 

20 printer, so that the simple printer is downloaded in 
step S29 and installed into an install destination 
(hard disk of the PC 300 or the hard disk of the 
compound machine 100) that is already specified in step 
S30. In addition, the simple printer is added to the 

25 application list. 
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The check items in the step S2 8 are, for 
example, program size, version, program latest update 
information, use memory work size, use storage size, 
use network address, the term of validity (usable 
5 number), application program name and the like. 

In the case when the simple printer is 
installed from a Web sit, the remote application 
management part 302 displays a screen for allowing the 
user to specify a URL of the Web server, so that the 

10 user inputs the URL from the screen in step S31. Then, 
the remote application management part 302 notifies the 
application management part 204 in the compound machine 
100 of the URL in step S32 . Then, the application 
management part 204 accesses the Web site of the URL in 

15 step S33, and checks whether the application (simple 
printer) in the Web site can operate the compound 
machine 100 from the PC 300 in step S34. This check 
can be also performed by the remote application 
management part 302. In this case, the application 

20 management part 204 obtains predetermined information 

(JNLP file for example) and send the information to the 
remote application management part 302. 

When it is determined that the application 
can operate the compound machine 100, the simple 

25 printer is downloaded in step S35, and installed in a 
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specified hard disk. Then, the simple printer is added 
to the application list in step S36. 

When the simple printer is installed, the 
simple printer can be selected from a screen of step 
5 S21. When the simple printer is selected, the remote 
application management part 302 loads the simple 
printer in the virtual machine 305 in the PC 300, so 
that the simple printer is executed in step S37. 

The simple printer operates the compound 

10 machine 100 by using the Java core class 304 and the 

client compound machine class 303. In the operation of 
the compound machine 100, for example, the simple 
printer 301 sends a message to the server compound 
machine application 210 in the compound machine 100, so 

15 that the server compound machine application 210 

operates objects in the Java execution environment in 
the compound machine 100 so as to operate the compound 
machine 100. 

As mentioned before, the simple printer 301 

20 initially displays the graphical interface screen. 

Whether displaying the screen on the PC 300 or on the 
operation panel of the compound machine 100 can be 
selected. For example, after the user selects the 
simple printer, the remote application management part 

25 302 displays a screen for selecting whether displaying 
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the screen on the PC 300 or on the operation panel of 
the compound machine 100, so that the selection is 
realized. In this embodiment, the PC 300 is selected 
and a screen that is an emulation screen of the 
5 operation panel is displayed on the PC 300. 

Next, the user selects, from the screen of 
the PC 300, a name of a file to be printed. The user 
can selects one among the hard disk of the PC 300 and 
the hard disk of the compound machine 100 as a storage 

10 of the file that the user wants to print. Since the 

user can selects the hard disk of the compound machine 
100, the user can perform operations on the PC 300 as 
if to operate the compound machine 100 on the operation 
panel. The selection can be performed by displaying a 

15 screen for selecting between the hard disks when the 
simple printer is selected by the remote application 
management .part 3 02.. 

When the hard disk of the compound machine 
100 is selected, the user specifies a file to print as 

20 'Vhdd/ts/photo . tif f for example from the screen of the 
PC 300. As a result, the file in the hard disk of the 
compound machine 100 is selected so that the file is 
printed. 

For ending the operation of the compound 
25 machine 100, the remote application management part 302 
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requests the application management part 204 of the 
compound machine 100 to end or pause the application, 
and ends communications with the compound machine 100. 

Like the second embodiment, also in the third 
5 embodiment, the Java application can be automatically 
updated by using the JNLP file. 
( Fourth embodiment ) 

In the following, another example regarding 
the remote operation of the third embodiment is 
10 described as the fourth embodiment. In the fourth 

embodiment, the compound machine 100 is configured as 
shown in Fig. 16. In the compound machine 100 in Fig. 16, 
the Java execution environment 116 and the Java 
application 117 are changed to a JSDK application 147 
15 and a JSDK platform 148. The JSDK platform 148 is for 
performing mediation with other software and 
application management and the like. 

^^SDK" means a specific software development 
kit, and an application developed by using the SDK is 
20 called ^^SDK application''. As a specific SDK, for 
example, ^^JSDK" is provided for developing an 
application by using Java language. An application 
developed by using the JSDK is called ""VSDK 
application" . 

25 Fig. 17 shows classes of the JSDK application 
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147 and the JSDK platform 148 in Fig. 16. The JSDK 
application 147 and the JSDK platform 148 are compiled 
from source code to byte code by a Java compiler, and 
are executed by a Java virtual machine step by step. 
5 The JSDK application 147 and the JSDK platform 148 are 
based on Personal Basis Profile of Java 2 Micro Edition. 

The JSDK application 147 includes a user 
application 501, a JSDK GUI Manager 511, and a Task Bar 
Manager 512. 

10 The user application 501 is a JSDK 

application developed by using the JSDK by a user (a 
software vender, for example) of the compound machine 
100. The JSDK GUI Manager 511 is a JSDK application 
for displaying operation screens for operating JSDK 

15 applications. The Task Bar Manager 512 is a JSDK 

application for displaying task bars for operating JSDK 
applications . 

The user application 501 is ^^Xlet" that is a 
Java application. Each of the JSDK GUI Manager 511 and 

20 the Task Bar Manager 512 is "'Xlet (XletEx) that is 
extended from the Xlet. 

The JSDK platform 148 includes classes such 
as a JSDK Main 521, a JSDK Environment 522, a Locale 
Manager 523, a Xlet Manager 531, a Multi Xlet Manager 

25 532, a JSDK Manager 533, a Send Manager 541, an Event 
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Manager 542, a System Event Manager 543, a Panel 
Manager 544, an Install Manager 545, a Server/Client 
Manager546 and the like. 

The JSDK Main 521 is a class for launching 
5 the JSDK Environment 522. The JSDK Environment 522 is 
a class for performing launch environment setting for 
the JSDK system. The Locale Manager 523 is a class for 
performing foreign language supporting and the like. 

The Xlet Manager 531 is a class for managing 

10 life cycle of the Xlet. The life cycle of the five 
Xlets are managed by five Xlet Managers. The five 
Xlets are in a one-to— one correspondence with the five 
Xlet Managers. All of the life cycle of the all Xlet 
managers are managed by the Multi Xlet Manager 532. 

15 The JSDK Manager 533 is a class for managing the life 
cycle of the whole of the JSDK system. For example, 
the life cycles of the Multi Xlet Manager 532, the Send 
Manager 541, the Event Manager 542, the System Event 
Manager 543, the Panel Manager 544, the Install Manager 

20 545 and the Server /Client Manager 546 are managed by 
the JSDK Manager 533. The life cycle of the Xlet is 
state transitions, for example, initialization state 
(Loaded) , paused state (Paused) , active state (Active) , 
end state (Destroyed) and the like. 

25 The System Event Manager 543 is a class for 
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managing system events (such as power mode) from the 
platform 120. The Panel Manager 544 is a class for 
performing mediation and the like when one Xlet 
occupies the screen of the operation panel. The 
5 Install Manager 545 is a class for managing install or 
uninstall of applications from the SD card and the Web 
server. 

The JSDK system of Fig. 17 includes JSDK API 
551 and JSDK API 552. The difference between the Xlet 

10 and the XletEx is that the XletEx can use the JSDK API 
551 for accessing objects and can access the JSDK 
platform. The compound machine 100 of Fig. 16 further 
includes a JSDK Session 553 and a Native JSDK Session 
554 that are interfaces between C language and Java 

15 language. The compound machine 100 of Fig. 16 further 
includes a CVM 555 that is a Java virtual machine. 

As shown in Fig. 18, the compound machine 100 
is connected to a' PC 701. The PC 701 functions as an 
emulator of the compound machine 100. 

20 The PC 701 in Fig. 18 includes, for example, a 

keyboard 712, a mouse 713, a display 714 and the like. 
The body 711 includes a CPU, a ROM, a RAM, a NVRAM, a 
HDD, a MODEM, and a NIC and the like. 

The keyboard 712 and the mouse 713 are 

25 hardware (operation part) used by an operator for 
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inputting data. The display 714 is hardware (display 
part) for outputting data. 

Fig. 19 shows classes of the JSDK application 
147 and the JSDK platform 148 in the PC 701. in Fig. 18. 
5 The PC 701 of Fig. 19 includes the JSDK application 147 
and the JSDK platform 148 same as those shown in Fig. 16. 

The differences between Fig. 17 and Fig. 19 are 
as follows . 

First, the Panel Manager 544 in Fig. 17 is 

I 

10 replaced by a Panel Manager Emulator 744 in Fig. 19. 

] Second, the JSDK Session 553 in Fig. 17 is replaced by 

I 

the Emulator JSDK Session 753 in Fig. 19. Third, the 
Native JSDK Session 554 of Fig. 17 is replaced by an 
Event Emulator 754 in Fig. 19. Fourth, the CVM 555 of 

15 Fig. 17 is replaced by the JVM 755 of Fig. 19. 

The Panel Manager Emulator 744 is a class for 
emulating the Panel Manager 544 to change operations of 
the operation panel to operations of the keyboard 712 
and the mouse 713. The Emulator JSDK Session 753 is a 

20 class for establishing communication routes. The Event 
Emulator 754 is a class for emulating operations of the 
compound machine 100. The JVM 755 is a Java virtual 
machine for executing the JSDK application 147 and the 
JSDK platform 148. 

25 Fig. 20 is a figure for explaining execution 
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procedure of preparation processes for remote operation 
in the compound machine 100. 

First, a communication session is established 
between the Server/Client Manager 546 in the compound 
5 machine 100 and the Server/Client Manager 546 in the PC 
701 (1) . The establishment of the session is performed 
by a protocol similar to SIP (Session Initiation 
Protocol) . 

Next, the Server/Client Manager 546 in the 
10 compound machine 100 asks the JSDK Manager 533 in the 
compound machine 100 whether the compound machine 100 
can change to the remote operation mode, so as to 
determine whether the remote operation can be performed 
(2) . 

15 When the remote operation can be performed, 

the Server/Client Manager 546 in the compound machine 
100 sends a request message necessary for remote 
operation to the PC 701 via the Send Manager 541 (3) , 
and receives a response message necessary for remote 

20 operation from the PC 701 via the Event Manager 542 in 
the compound machine 100 (4) . 

Next, the Server /Client Manager 546 in the 
compound machine 100 requests the Panel Manager 544 to 
send information for remote operation to the PC 701 (5) . 

25 Finally, between the Server/Client Manager 
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546 in the compound machine 100 and the Server/Client 
Manager 546 in the PC 701, notifications are exchanged 
for notifying each other of completion of preparation 
of remote operation (6) . Accordingly, the remote 
5 operation from the PC 701 to the compound machine 100 
can be performed. Functions for realizing distribution 
processes of applications described in the third 
embodiment can be included, for example, in the 
Server/Client Manager 546 in the compound machine 100 

10 and the Server/Client Manager 546 in the PC 701. 

Each program described in the first to fourth 
embodiments can be stored in a recording medium such as 
a memory card. From the recording medium, the program 
can be installed in the compound machine 100. In 

15 addition, a program for constituting the Java execution 
environment such as the virtual machine can be also 
stored in a recording medium such as a CD-ROM, and can 
be installed in the PC 300 from the CD-ROM. 

As mentioned above, according to the present 

20 invention, by providing a Java execution environment in 
the compound machine 100, the Java application can be 
easily installed and launched on the compound machine 
100. Therefore, the Java application can be easily 
executed. In addition, the compound machine 100 can be 

25 operated by executing a Java application in a terminal 
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apparatus connected to the compound machine 100 via a 
network . 

The present invention is not limited to the 
specifically disclosed embodiments, and variations and 
5 modifications may be made without departing from the 
scope of the present invention. 

The present application contains subject 
matter related to Japanese patent application No. 2003- 
082908, filed in the JPO on March 25, 2003, and 
10 Japanese patent application No . 2004-078979 , filed in 

the JPO on March 18, 2004, the entire contents of which 
being incorporated herein by reference. 
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